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OPTIMAL DESIGN PROCEDURE FOR TWO-LEVEL FRACTIONAL FACTORIAL 
EXPERIMENTS GIVEN PRIOR INFORMATION ABOUT PARAMETERS 
by Steven M. Sidik and Arthur G. Holms 
Lewis Research Center 

SUMMARY 

In many cases in practice an experimenter has some prior knowledge of indefinite 
validity concerning the main effects and interactions which would be estimable from a 
two-level full factorial experiment. Such information should be incorporated into the 
design of the experiment. 

This report presents a method for incorporating such knowledge when the prior in- 
formation can be expressed as prior probabilities that each main effect or interaction 
will be nonzero. 

A review of fractional factorials, blocking of factorial designs, and telescoping se- 
quences of blocks is presented. It is shown how, by using these techniques, the experi- 
mental design problem may be posed as a finite decision problem. Then for the finite 
decision problem, Bayes and mini-max strategies are developed and their application 
to the design problem illustrated. The major computational step is the evaluation of all 
possible matchings of physical variables to the abstract variables of all potential de- 
signs . 

The technique of telescoping sequences of blocks permits the consideration of ex- 
periments to be performed and analyzed in stages . 


INTRODUCTION 

Confounded full and fractional factorial experimental designs have become a widely 
used and valuable experimental tool since their development by Fisher (ref. 1) and 
Finney (ref. 2). They are often used where there are several factors (independent varia- 
bles) which may jointly influence the level of a response (dependent variable). The as- 
sumed relation between the dependent variable Y and the independent variables X A , 

X B , ... is of the form 



Y = % + ^A X A + /3 B X B + ^AB X A X B + &C X C + ^AC X A X C + ^BC X B X C + ^ABC X A X B X C 


+ . . . + /3 ABC _ # . X A X B X C • 


. + 8 


( 1 ) 


where for repeated observations the 5 are independent random variables with mean 
zero and finite variance, and the /3’s are unknown parameters some of which the ex- 
perimenter wishes to estimate . (All symbols are defined in appendix A . ) 

If a fractional replicate of a full factorial experiment is run, not all the parameters 
whose existence is implied by equation (1) can be estimated. Instead, only certain linear 
combinations of these parameters can be estimated. 

For example, a one-half replicate experiment on four independent variables would 
provide eight estimates which might (depending on the fractional plan chosen) be esti- 
mates of paired combinations of parameters as follows: 


% + %BCD % + ^ABC 

^A + %CD ^AB + ^CD 

% + ^ACD ^AC + ^BD 

0C + ^ABD ^AD + ^BC 


From such estimates, nothing can be inferred about any single parameter without making 
assumptions about, or having prior information about, the other parameter of a paired 
combination. 

In the general situation the experimenter often has some prior beliefs about which 
parameters are nonzero, and he can state such beliefs with varying shades of convic- 
tion, according to the particular parameter being considered. If pressed, he should 
state those odds that he would be willing to take on either side of a bet that a particular 
parameter is nonzero. If his odds are w:z that an interaction between X 2 and is 
nonzero, his subjective prior probability that j 3 23 is nonzero is p = w/(w + z). 

The experimenter could match his physica l variable names X^, X 2 , X^, X^ to the 
design variable names X A , X B , X^, X B so that the lower prior probability param- 
eters of the paired combinations could be dropped, under the following conditions. The 
experimenter's prior probabilities of nonzero three- and four -factor interactions were 
all less than 0.01. He believed that prior probabilities of nonzero two-factor inter- 
actions between Xj and any other independent variable and X 2 and any other indepen- 
dent variable were less than 0.05. This matching is as follows: 
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( 2 ) 


If the experiment is performed and numerical values are computed for the maxi- 
mum number of parameter estimates, the equation for Y could be written 

Y = bg + bgXg + + ^2^2 + ^34^3^4 + ^31^3^1 + ^32^3^2 

Equation (3) thus represents a combination of the experimenter’s prior knowledge with 
the information that could be extracted from the one-half replicate experiment. 

As illustrated by the preceding example, the experimenter can maximize the infor- 
mation obtained about parameters , while minimizing the number of experimental units 
performed, if he uses a judicious matching of the physical variables X^, Xg, Xg, . . . 
to the design variables X A , X B , X c , . . . Thus, one problem of constructing an opti- 
mal design is to find a "best" matching for a given design. 

After presenting a survey of some pertinent topics such as fractional factorials, 
blocking, and telescoping blocks, this report establishes definitions for "best" designs 
and methods for finding the best or nearly best designs. Appendix B contains an illus- 
trative example. 

The reader is assumed to have a knowledge of two-level factorial designs as might 
be found in Davies (ref. 3), Peng (ref. 4), or Kempthorne (ref. 5). Some results from 
elementary decision theory and game theory are used. Some references on this subject 
are Raiffa (ref. 6), Raiffa and Schlaifer (ref. 7), and McKinsey (ref. 8). 

A method for systematically comparing the possible combinations and choices of in- 
terest and a computer program for performing some of the calculations have been devel- 
oped and are presented in Sidik (ref. 9). 

STEPS IN THE DESIGN OF FACTORIAL EXPERIMENTS 

The decisionmaking in the design of an experiment can be subdivided into steps as 
follows: 
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(1) What quantities to vary : The quantities that will enter into the investigation as 
controlled independent variables must be decided upon. In taking this step, there should 
be no intention that other variables will be added later. The full list of potentially im- 
portant variables should be incorporated into the initial experiments so that interactions 
among the variables can be observed. 

(2) In what way to vary the variables : The variables are sometimes introduced 
through linearizing transformations . For example, the velocity of a fluid is the depen- 
dent variable and differential pressure is an independent variable . Then the levels of 
the differential pressure chosen for the investigation might be a uniform sequence of 
values of the square root of the differential pressure. Thus approximately linear re- 
sponse would be achieved on that particular independent variable . 

(3) Starting region of the experimentation: This is specified so that the midpoint of 

the values of the independent variables is located at the point in the experimental space 
that is thought to be of the greatest interest or importance. 

(4) Amounts by which the independent variables are varied : The increments between 
successive levels of the independent variables are ideally large enough so that the depen- 
dent variable will ± espond by an increment significantly larger than the random error . 

On the other hand, the increments of the independent variables should be small enough 
so that the resulting observations will not be too irregular to be fitted to the intended 
model (e.g. , eq. (1)). Furthermore the increments should be small enough so that the 
independent variables do not leave the range of the experimental space that is of prac- 
tical interest. 

(5) Number of levels for the independent variables : In this connection the composite 
designs that were closely studied by Box and Hunter (ref. 10) are known to be highly effi- 
cient in providing the data for fitting model equations of considerable usefulness. The 
beginning point of the composite design is the full or regular fraction of the two-level 
factorial experiment. 

(6) Block size : One approach to designing experiments so that they will have good 
statistical properties and still be no larger than necessary is to design them as tele- 
scoping sequences as in Addelman(ref. 11) and Holms and Sidik (ref. 12). In such se- 
quences the first block is conveniently one that is just large enough to estimate all the 
coefficients of a first -degree model equation. (Physical limitations might occasionally 
dictate that a smaller block size must be used.) 

(7) Choice of defining contrasts and matching of physical variables to design varia- 
bles: This is the main subject of this report. 
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BASIS OF DESIGN OF TWO-LEVEL FACTORIAL EXPERIMENTS 


Notations for Treatments, Contrasts, Parameters, and Estimates 

A two-level factorial experiment with n independent variables X A , Xg, X^,, . . . 
is an experiment in which the response or dependent variable is assumed to depend upon 
the independent variables as indicated by equation (1) of the INTRODUCTION. 

A combination of the levels of the independent variables is called a treatment com- 
bination or just a treatment. A treatment represents an experimental condition under 
which an observation might be made. If there are n independent variables and the 
variables are restricted to assuming only two possible values, there are 2 n possible 
treatment combinations. If observations are made at each of the 2 n treatment com- 
binations, all the parameters of equation (1) can be estimated. 

The values of the independent variables can be coded so that they take on the values 
+1 or -1 only. The ’’upper” level or "high” level is represented by X A - +1, 

Xg = +1, and so forth. The ’’lower” or "low" level is represented by X A = -1, 

Xg = -1, and so forth. Since a treatment combination is a specified combination of the 
levels of the independent variables, a treatment combination may be identified as a vec- 
tor of +l’s and -l's; for example, 

(x D , x c , x B , X A ) = (-1, -1, +1, -1) 

Another frequently used notation involves the use of combinations of the lower case let- 
ters of the alphabet. The presence of a letter denotes that the independent variable 
having the associated upper case of that letter as a subscript is at its high level. The 
symbol (1) is used to denote the low level. Thus, the preceding treatment combination 
may be written 


(x D , x c , x B , X A ) = (-1, -1, +1, -1) = (l)(l)b(l) = b 
A second example is 

(X D , X c , X B , X A ) = (+1, +1, -1, -1) = dc(l)(l) = dc 

In what follows it is convenient to be able to order the treatment combinations and 
parameters in a standard order. For convenience, the independent variables are or- 
dered alphabetically from right to left as Xg, Xg, X^, Xg, X A> This order is the 
opposite of that used in the INTRODUCTION and SUMMARY and is used in the remainder 
of this report. 
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Let the v th 


treatment combination be denoted 


t = t 

v m m„ i 
n n-1 


m i 


The subscript on the right is v written as a binary number. Then t is identified as 

xi_ V 

the treatment combination which has the i independent variable (from the right) at its 

-f*Vi 

low level if m^ = 0 and has the 1 independent variable at its high level if rm = 1. 
Thus the preceding examples can be written 

(x D , x c , x B , x A ) = (-1, -l, +1, -l) = (D(i)b(i) = b = t 001Q = t 2 

(X D , X c , X B , X A ) = (+1, +1, -1, -1) = dc(l)(l) = dc = t uoo = t 12 

Table I presents the design matrix for a 2 factorial. The column labeled "Treat- 
ment" gives both the t and alphabetic notation for the eight treatment combinations. 
The column labeled "Observed response" gives the eight y values observed. The 
remaining columns give the values of X A , Xg, X^,, and their products. 

The same kind of ordering as has just been developed for the treatment combinations 
can be developed for the parameters of a model equation for a factorial experiment. In 
fact, it can easily be seen that the terms of equation (1) are already arranged in stan- 
dard order with the parameters having alphabetic subscripts. Suppose the independent 

i.U 

variables are ordered from right to left. Then let the v m parameter be denoted 


^v ^m m„ 1 
n n-1 


m. 


where the subscript on the right is v written as a binary number. Then if m^ , 

designate the digits that equal 1, B is the coefficient of the k-factor 


m. 

2 2 


m. 

2 k 


interaction between the i^, i 2 , . . . , i k independent variables, recalling that they are 
ordered from the right. An interaction represents the fact that the effect of the change 
of level and some independent variable on the response might depend upon the levels of 
other independent variables. A two-factor interaction between two independent variables 
(e.g. , X A and Xg) indicates that the amount by which a change in X A changes the de- 
pendent variable depends upon the particular value of Xg. Likewise, the amount by 
which a change in the level of X B changes the dependent variable depends upon the par- 
ticular value of X A . Interaction among three or more independent variables is defined 
similarly. The only difference being that there are dependencies on more variables. 

To estimate the parameters of equation (1) the method of least squares may be used. 
In this special case of two-level factorial designs the method of least squares leads to a 
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simple rule: the parameter associated with the heading of a column (such as in table I) 
is estimated by the linear combination of the y’s indicated by the +l’s and -l's in 
that column divided by the number of observations. For example, from the data of 
table I, the estimate of /3^ is 

b A = (" y l + y 2 ' y 3 + y 4 ' y 5 + y 6 " y 7 + y 8^ g 


All the columns are linear combinations and are called contrasts. In a full two-level 
factorial design there is a one-to-one correspondence between the contrasts and the 
parameters. 


Use of Elementary Group Theory 


Some elementary notions from group theory are useful in simplifying the notation 
and later discussions. 

A group is a set G of elements and an operation ® defined upon any two elements 
from G which satisfies the following properties: 

(1) If aeG and beG, then a®beG. 

(2) If aeG, beG, and ceG, then (a®b)®c = a®(b®c). 

(3) There is some element of G denoted as (1), such that a®(l) = (l)®a = a for 
all aeG. 

(4) For every aeG, there is some element we denote as a”* such that a® a - '*' 

= a _1 ®a = (1). 

Let T = {t y } represent the full set of treatment combinations and B = { j3 y } represent 
the full set of parameters. A group structure may be imposed upon both sets by intro- 
ducing the product ® defined by 


and 



mi ®0k n 










(4) 


where 


j i = (m. + kjMmod 2) 

J 
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This notation is completely analogous to the more common notations using the let- 
ters of the alphabet where, for the treatments, 


m, m 


V “ 2 . . .(glaV 2 . . 


ii jo 
= a *b 1 


Note that this notation does not imply that parameter values are to be multiplied but is 

used to indicate the relations between parameters, treatments, and contrasts. 

Suppose n = 4. Then we may use the alphabetic notation for T to illustrate how T 

and ® form a group by showing that the properties 1 to 4 hold. T contains all possible 

combinations of the four letters a, b, c, d including the ” combination" (1) where none 

f i 4 i, i 2 i-i 

are present. Thus we may say T =|d ’c b a : i. = 0 or 1 in all possible combina- 
tions! and define a 0 = b° = c° = d° = (1). Then any two elements w 4 and w 2 of T 
will be of the form 


1 4 i 2 H 

Wj = d u ^b ^a 1 


w 2 = dW 1 


and 


^(i 4 +j 4 )(mod 2) (i 3 +j 3 )(mod 2)^(i 2 +j 2 )(mod 2) (ij+j^mod 2) ^ 

12 

It is clear that since the exponents are reduced modulo 2, no new combinations of letters 
other than those in T can be formed. This satisfies the first requirement of a group. 
The second requirement is clearly true by the way ® was defined. Now note that since 
(1) = d^c^b^a®, multiplying any element by (1) will not change the values of the expo- 
nents so that (l)®w = w. Thus the third requirement is satisfied. Suppose 

i 4 i„ i„ i. 2i 4 (mod 2) 2i„(mod 2) 

w = d ^c ^b ^a 1 is any arbitrary element of T . Then w® w = d ’ o' 3 

^2i 2 (mod 2)^2i 4 (mod 2) _ d® c ®b^a^ = (1). Thus every element serves as its own inverse 
and the fourth requirement is satisfied. 

A subgroup of a group is a subset of the full set which is also a group under the 
same operation. For example, consider the set { (l),a} which is a subset of { (l),a,b, 
ab} . It can be verified that under the operation ® as previously defined, { (1) , a } is a 
group and { (l),a,b,ab} is a group and hence { (1) , a } is a subgroup of { (l),a,b,ab| . 
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Let G* be a subgroup of G under the operation (x) Let w be some arbitrary 
element of G and let w(x)G* denote the set of elements {w(x)t.p wCxHg, . . . , 
w®t } , where the t^ are the elements of G* . Such a set is called a coset of G* . 

Two elements of a group will be called orthogonal if in their alphabetic representa- 
tions they have an even number of letters in common. They will be orthogonal also if in 
the binary subscript notations they have an even number of l’s in common locations. 

Thus, 0CBA is orth °g onal to 0 D cb> dcb is ort hogonal to dca, and t 111Q is or- 
thogonal to tQm* Orthogonality may also be defined between different groups so that 
for example, Pq-qa = ^0111 is or thogonal to dca = t^Q^. 

Fractional Factorials 

It is often impractical to perform all 2 n treatment combinations of a full factorial 
experiment. In many cases in practice there are seven or eight or more independent 
variables so that the full factorial with 2 n treatments might be too expensive to per- 
form. Also, it is often assumed that only some of the possible parameters of equa- 
tion (1) are nonzero. In particular, it is generally assumed that higher order interac- 
tions either do not exist or else are associated with effects of small magnitude. Thus, 
it is of interest to determine how the number of observations and the number of esti- 
mated coefficients can be reduced from a full factorial in a manner consistent with the 
experimenter’s objectives. 

A common way of reducing the number of treatment combinations is to perform a 
regular fractional replicate . A regular fractional replicate is any coset of a subgroup 
T^ of T. The subgroup T^ is sometimes referred to as the treatment subgroup or 
principal fraction. 

Finney (ref. 2) has shown that for every subgroup T^ of T there exists a subgroup 
B^ of B called the complete orthogonal subgroup which contains every element of B 
which is orthogonal to every element of T^. The complete orthogonal subgroup will be 
referred to as the defining parameter group (d.p.g.) and its elements called the defining 
parameters. It is also true that for every subgroup B^ of B there is a subgroup T^ 
of T such that T^ contains every element of T which is orthogonal to every element 
of B r 

It has been previously stated that if a regular fractional replicate is performed, not 
all the parameters of equation (1) can be independently estimated. Only certain linear 
combinations of the parameters can be estimated. If there are 2 n-r observations in a 
regular fraction, there can be only 2 n_r contrasts that are linearly independent. Each 
of these contrasts is an estimator of a linear combination of the parameters appearing 
in a single coset of the complete orthogonal subgroup. 
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All subgroups of T will have 2^ treatment combinations in them for some 

q = 0,1, . . . , n. If a 2 -r fractional factorial is performed, it will consist of 2 n-r 

treatment combinations and there will be 2 n-r cosets each containing 2 r parameters . 

3 

As an example of these points consider a one -half replicate of a 2 experiment 
with defining parameter group where 

B 1 = ^CBA^ = { ^000’ = ^0’ ^7^ 

Then by the ’’rule of even numbers” (ref. 3), it can readily be shown that 

T 1 = {(1), ba, ca, cb} = { *000’ *011’ *101’ *110 ^ = ^*0’ *3’ *5’ *6^ 

The three remaining distinct cosets of B^ are 

0A® B 1 = ^ %’^CB^ 


%® B 1 _ t %»^CA^ 


%A® B 1 " 

A s ummar y of this experiment is given by the first four lines of table II. Let us 
apply the simple estimation rule previously stated for the full factorial case but simply 
ignore the observations not available. That is, the parameter associated with the head- 
ing of a column (contrast) is estimated by the linear combination of the available y’s 
indicated by the +l's and -l's in that column divided by the number of observations; 
for example, 



- y l + y 2 +y 3 " y 4 
4 


However, note that 


CB 


y ! - y 2 - y 3 + y 4 


= -b. 


Actually, (-y^ y 2 + y 3 “ y 4 ) 7 estimates &a ~ &CB' 


If is assumed to be zero, it 
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may be said that the preceding linear combination of y’s estimates If / 3 q B is 

assumed to be zero, it may be said that the linear combination estimates / 3 A - The name 
assigned to the estimator depends upon the assumptions made . Thus , in a simplified 
sense it may be said that each independent estimator may be assigned more than one 
name. This situation arises in the following way. For a full factorial design, the con- 
trasts which estimate each parameter are linearly independent of each other. When a 
regular fractional replicate is performed, there will be a reduced number of linearly 
independent contrasts. Each of these contrasts will provide an estimate for a linear 
combination of certain of the parameters. This was illustrated previously where the 
contrast ^(-y^ + ^2 + y 3 ” y 4 ) es ^i m ates /3 A - It was shown by Finney (ref. 2 ) 

that the linear combination of parameters that a given contrast estimates will contain 
all the parameters in the complete orthogonal subgroup or one of its cosets, and no 
other parameters. This may be illustrated as follows: 

(!) + y 2 + y 3 + y 4 ) estimates /3j - /3 CBA 

(2) 4(^1 + ~ y 3 + y 4^ estimates 0 B - /3 ca 

(3) \(-Y 1 ~ y 2 + y 3 + y 4 ) estimates /3 C - |3 BA 
as can be readily checked from table II. 

For each parameter in a 2 n factorial there can be uniquely associated one contrast 
which estimates it from the data of a full factorial. From a fractional factorial there is 
a smaller number of observations . If the components of the contrasts corresponding to 
the observations not made are dropped, each parameter in a coset will have the same 
contrast of the available observations (except for possibly a change of sign). The d.p.g. 
’’defines” the experiment in the sense that the treatment subgroup (or some coset of the 
treatment subgroup) which contains every element of T which is orthogonal to every 
element of the d.p.g. will constitute a regular fractional replicate of the full factorial. 
The alias sets resulting from the estimation rule given previously will be cosets of the 
d.p.g. 


Blocked Factorial Designs 

A problem often encountered in practice is that of maintaining uniform experimental 
conditions throughout the period of experimenting. A method called block confounding 
was developed (ref. 1) to help minimize biasing the parameter estimates of a factor ial 
experiment when it is known or suspected that certain conditions which are not of par- 
ticular interest or not readily measurable change. 

Suppose an experimenter wishes to perform a 2“ r fractional factorial experiment 
on n independent variables, but cannot assure that conditions will be uniform for all 
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2 n “ r treatment combinations. He can assure, however, that 2 W (w < (n - r)) treatment 
combinations can be rim under the same conditions. 

The procedure for constructing a blocked fractional factorial is as follows: Choose 
a subgroup of B that defines a fractional replicate with 2 n “ r treatment combina- 
tions. Let these treatment combinations be a subgroup of T. Choose a subgroup 
B 2 of B containing B^ so that Bg defines a fractional replicate with 2 W treatments. 
Let these treatments be a subgroup Tg of T such that Tg is a subgroup of T^. Then 
the subgroup Tg and its cosets are called blocks. The expectation of the population re- 
sponses over a block is called the block mean. It was shown in Holms and Sidik (ref. 12) 
that the estimators for those alias sets which contain parameters which are elements of 
Bg but not elements of B^ are also estimators of linear combinations of the block 
means. All other estimators are linearly independent of the block means. An aliased 
set of parameters whose estimator also estimates a block effect (linear combination of 
block means) is said to be confounded with blocks. 

As an example of this confounding, consider the experiment summarized in table II, 
where n = 4, r = 0, and w = 2. The two blocks are the sets of treatment combinations 
{ (l),ba,ca,cb} and {a,b,c,cba} . It can be shown that the d.p.g. for the fractional 
replicate corresponding to those treatments in block 1 is Bg = { /3£ BA } . In this ex- 
ample, B 1 = { 0j} . Thus the estimator for /3 CBA is confounded with any block effect. 
This may be easily seen by recalling the previously stated estimation rule that 

(y 5 + y 6 + y 7 + y 8^ -(yi + y 2 + y 3 + y 4 ) 

b CBA o 


l / y 5 + y 6 +y 7 + y 8 . y l +y 2 + y 3 +y 4 
2 \ 4 4 / 



where pj is the estimated block mean of block i. More detailed developments of this 
aspect can be found in references 3, 4, 5, and 12. If a 2 n factorial is divided into a 
2 n “ r fractional factorial and then further divided into blocks with 2 W (w < (n - r)) 
treatments per block, there are 2 n " r " w blocks in the fractional factorial. 


Telescoping Blocks 

The previous two concepts of fractional replication and blocking of factorial experi- 
ments can be combined to provide a means of sequentially adding blocks to the factorial 
while retaining the properly of orthogonal blocking. This technique is called telescoping 
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and a description of double and multiple telescoping is given by Holms and Sidik in ref- 
erence 12. Addelman (ref. 11) has tabulated many single telescoping designs. 

An experimenter may begin experimenting with a very small fractional replicate as 
one block. The treatment combinations used and the alias sets available are defined by 
a choice of defining parameter group B^. This is a subgroup of B, the full parameter 
group. When the experimenter completes the first block, he has the option to continue 
experimenting or to stop. If he stops, he has a small number of estimators each of 
which is associated with a large alias set. If he elects to continue with regular frac- 
tional replicates, he must at least double the current size of the experiment. He may 
do this by choosing a subgroup Bg of B^ and performing a second block of treatment 
combinations. The added treatment combinations are given by those which are ortho- 
gonal to Bg but have not already been performed. In addition to a reduction in the var- 
iance of the estimates, the gain from continuing to the new stage will be that there will 
be twice as many estimators available and each alias set will have only one -half as many 
elements as the alias sets of the one -block experiment. An important fact is that one 
estimator will be confounded with the block difference between blocks 1 and 2. 

In general, suppose experimenting is started with a 2 -r replicate and that it is also 
a single block. Then an experiment will be said to be at the stage if it contains 

7 1 j-u 

2 l ~ l blocks. Let the treatment group at the t n stage be written as T(Z) and the 
d.p.g. at the stage as B (l). Let T(r + 1) be the full treatment group and B(0) be 
the full parameter group. The number of elements of B(Z) is one -half that of B(Z - 1) 
and the number of elements of T(Z) is twice that of T(Z - 1). The parameters con- 
founded with blocks at any stage are given by the elements of B(l) that are not elements 
of B(Z). This rule is valid only for single telescoping. More complex rules are indi- 
cated in reference 12 for the case of multiple telescoping. 


USE OF GAME AND DECISION THEORY 
Estimability of Parameters 

An estimator for an alias set is generally useless unless all except one parameter 
in the alias set are known. The conventional rules for estimability use the basic as- 
sumption that the response function is ’’smooth” to justify assuming all the high-order 
interactions are zero. Thus, common practice is to assign the estimator to the param- 
eter in the alias set which represents the lowest order interaction. If there are ties, 
the estimator is either discarded or assigned to a particular parameter based upon other 
considerations. Thus, for example, the estimator for { ^A’ ^EDCB’ @CB’ ^EDA^ wou1( * 
normally be assigned to j 3 a , whereas specific prior knowledge would be required for 
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the estimator for { %), /3 E cBA> %CBA> % } to be assigned to /3 q or /3 E< 

Suppose now that the experimenter has some knowledge which enables him to assign 
a prior probability to each parameter. The prior probability measures his prior degree 
of belief that the parameter is nonzero. This knowledge may have been obtained from 
experiments in more or less similar situations, or it may be in the form of some theo- 
retical relations he knows of. Such knowledge can indicate which parameters are more 
likely to be nonzero than others. 

i.U 

Consider the problem of matching estimators and parameters at the h ul stopping 
point. The d.p.g. is B(h), and the alias sets are all those distinct cosets of the form 
&®B(h) = /ft , /3 X . Let P ( & ^ o\ = p. . If the estimator for the alias 

1 l h x 2 W V x j / 

set /3. ®B(h) is assigned to the parameter /3. , then assuming independence, the prior 
1 x k 

probability that the estimator will be unbiased is 

FT (i - P .) (6) 

jeS(i,h) 

j^ k 

This probability is used to help find a "best" matching of estimators to parameters. 

Formulation of the Problem 

All the preceding discussion concerning fractional factorials, blocking, telescoping 
designs, and estimability of parameters from these designs can now be put together to 
represent the steps of the design and performance of an experiment as a finite game be- 
tween nature and the experimenter . 

The experimenter is free to choose any of the parameters in an alias set to be as- 
signed the estimator. The experimenter is also free to choose the design-variable-to- 
physical -variable matching. It is very likely that different matchings will obtain differ- 
ent values to the experimenter since changes in the physical -design variable matching 
will cause changes in the elements of the alias sets. 

The experimenter is free to choose a telescoping design. This involves the choice 
of initial d.p.g. and the sequence of subgroups (or he might choose a multiple tele- 
scoping design with branch point decisions restricted by nature). Thus the decision 
space for the experimenter is composed of the choice of initial d.p.g. , choice of se- 
quence or sequences of subgroups, choice of physical -design variable matching, and 
choice of parameter -estimator matching. 
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Nature has the choice of which of the /3’s will be nonzero and the choice of the path 
and the stopping point of the telescoping. 

A decision ’’tree” is a graphical representation of the possible sequences of choices 
the experimenter and nature can make. A decision tree representing all the preceding 
choices would, in general, be much too large to be conveniently represented. A flow 
diagram is presented in figure 1 which indicates the sequence of choices to be made by 
the experimenter and nature. 

It should be noted that the order of presentation shown in figure 1 of the choices of 
nature and the experimenter are not necessarily in temporal order. The choice of 
d.p.g. and physical-design variable matching are interchangeable but must be made be- 
fore the actual execution of the experiment. Nature's choice of the parameter values 
would normally be made prior to anything the experimenter does. However, it does no 
harm to conceive of nature being permitted to choose the parameter values after the ex- 
periment is performed. In fact, this concept is more convenient in describing the Bayes 
decision procedure for the experimenter . 

In order to evaluate all these possible outcomes, the relative value of each possible 
outcome to the experimenter should be specified. These relative values are defined as 
utilities . 

Once given the structure of a game or a decision problem and the utilities of the out- 
comes, the statistician must devise a method for choosing the possible alternatives so 
that a desirable outcome is finally attained. The possible methods for making decisions 
are called strategies . More precisely, a strategy for the experimenter is a set of rules 
which specify what choice is to be made from the alternatives available as a function of 
all previous choices at every possible point where a choice is to be made. 

There are two general principles by which strategies are ordered which are in cur- 
rent use. One is called the Bayes principle and the other is called the mini-max prin- 
ciple. 


The Bayes Solution 

The Bayes procedure assumes that nature is an indifferent participant in the game. 
Thus, the choices that nature makes are independent of the choices available to the ex- 
perimenter, but instead are made according to a specified probability distribution. Any 
information the experimenter may have concerning the strategy (specified probability 
distribution) nature will follow is useful information that should be incorporated into the 
decision procedure. The strategy which maximizes the utility given the assumed 
strategy for nature is called the Bayes strategy. Thus, let us assume the experimenter 
has prior information which he can express as probabilities of each parameter being 
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nonzero and probabilities of stopping exactly at a given stage of the experiment. Let 
/3 y be the v parameter in the standard ordering and let P(/3 y / 0) = p y . Let 


/ Experiment is terminated \ 

P I at exactly the h** 1 1 = 

\ stopping point J 


Phs 


Let us restrict the utilities so that u.(h) is the utility of obtaining an unbiased estimator 

til * 

for ^ at the h stopping point and assume u^(h) = 0 if the estimator is biased. We 
allow it to be some finite value greater than or equal to zero if the estimator is not 
biased. 

Suppose at the box in figure 1 marked with a star (★), l stages have been completed. 
Then there are 2 n-r+ ^"* alias sets of the form &®B(Z) = /& , & , . . & \, 

l 1 2 V) 

where m = 2 . From each alias set, one parameter may be chosen to be assigned 

the estimator. Independently of these assignments, nature now chooses which of the 
parameters are zero. By the previously stated assumptions, the experimenter cannot 
be sure what nature will do for this particular instance, but he does know with what prob- 
abilities the parameters will be nonzero. Thus, the proper thing to do is to compute the 
expected utility for each possible assignment from the alias sets. 

Let the utility placed upon an unbiased estimate of j3^ at the h cn stopping point be 
denoted by u^h) . Let the expected utility to the experimenter gained by assigning the 
estimator for the alias set to the parameter /3^ be denoted by U(i,k). Then 


U(i,k) = u k (h) FT (1 - pj (7) 

k jeS(i,h) 3 


The experimenter should thus assign the estimator to the parameter which maxi- 
mizes this quantity. A special case requires separate discussion. Suppose that an alias 

Y — Z +1 

set is confounded with some block effect. In this case there are 2 +1 param- 

eters in the alias set. Assume that prior probabilities can be assigned to the event that 
each block effect will be nonzero and assume the utility of an unbiased estimate can be 
specified. Then this information can be incorporated into the decision procedure by 
computing the m + 1 expected utilities: 


U(i,k) = u k (h) 


TT (i 

jeS(i,h) 

L 


- p i> 


(1 -Pb> 


( 8 ) 
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U(i,b) = u b 


(9) 


n <1 

j€S(i,h) 



where 


p^ = P { the block effect 4 0 } 

and u b is the utility of an unbiased estimate of the block effect and U(i,b) is the ex- 
pected utility gained by assigning the estimator for j3^(x)B(h) to the block effect. 

Since the alias sets are disjoint and the estimators for each alias set are indepen- 
dent of each other , it follows that the choice of parameter from one alias set need not 
influence the choice from another alias set. Thus, the restriction on the utility function 
that sets it equal to zero for biased estimators and the use of the expected utility imply 
that the number of choices at the boxes marked with a 'h and a * is (2 r- ^ + ^)(2 n_r+ ^ ”*) 

ffl 

= 2 , where l is the number of stages comprising the h stopping point. This is the 
number of alias sets times the number of choices that could be made from each alias 
set, and is equal to the number of factorial parameters, ignoring block parameters. 

7 +U 

Thus, let the total utility to the experimenter at the h stopping point be denoted 
U(h) =2jU(i,k), where the summation is over all the distinct cosets at the h tn stopping 
point. Let 


U = 


P »s C(h) 


h=l 


( 10 ) 


Then U represents the expected utility over all stopping points for a fixed choice of 
initial d.p.g. , telescoping sequence or sequences, and physical -design variable match- 
ing. The formal Bayes solution to the decision problem would then be to compute the 
value U for each of the possible choices of initial d.p.g. , naming, and telescoping 
sequences, and then choose the combination which gave the maximum U. This involves 
a large number of alternatives. 


Modified Bayes Solution 

As a practical procedure, it seems highly unlikely that all the possible d.p.g.’s will 
be evaluated . There would be far too many alternatives to compute the formal Bayes 
solution in many problems. Common sense may, however, indicate some reasonable 


17 



ways to reject certain types of d.p.g. ’s depending upon the given utilities and proba- 
bilities. 

Many experimental situations satisfy the condition that the higher the order of inter- 
actions, the greater the probabilities of their being small or absent, and therefore the 
smaller their expected utilities . This is the typical situation and it seems likely that the 
"best" design in this case will be one of the designs derived on the basis of resolution 
level. (For a given number of independent variables, these kinds of designs occur at the 
beginnings of the lists in Addelman (ref. 11).) 

A different situation might conceivably arise when there are essentially two sets of 
independent variables under consideration. One of these sets is known to contain ele- 
ments interactive among themselves. The second set, however, is known to have first- 
order effects upon the dependent variable; but these elements do not have much tendency 
to interact. (For such situations, the appropriate designs might occur at the ends of the 
lists in Addelman (ref. 11).) 


Mini-Max Solution 

To derive a mini-max strategy, the statistician assumes nature to be an aggressive 
player who will choose alternatives available to her which will minimize the maximum 
utility the statistician may gain. Thus the experimenter is the maximizing player, and 
nature is the minimizing player. 

A strategy for nature involves two component choices: the choice of which param- 
eters will be nonzero and the choice of the path and stopping point of the telescoping. 

One choice available to nature which the experimenter has no influence upon is the choice 
of nonzero parameters. In fact, it is possible that nature may choose to let every pa- 
rameter be nonzero. In this instance it will not be possible to obtain unbiased estimates 
for any parameter until the full replicate is rim. If the utility function is restricted to be 
zero when the estimator is biased, there is zero utility except for the full replicate. 
Thus, the only possible way for the experimenter to obtain a gain is to design for the full 
replicate. However, nature also may choose the stopping stage; and so to minimize the 
experimenter’s utility, any stage other than the full replicate may be chosen. Thus, any 
strategy at all that the experimenter uses will be a mini-max strategy, for nature can 
always assure that the experimenter will receive zero utility. 

Two less aggressive strategies for nature are conceivable. The first assumes that 
nature will still choose to have every parameter nonzero but will stop the experiment at 
one of the stages according to prior probabilities known by the experimenter. Then the 
only reasonable approach for the experimenter is to choose a design which maximizes the 
utility of the full factorial. Clearly, this only involves minimizing losses due to block 
confounding. 
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The second of these less aggressive strategies allows that nature will choose the 
parameters to be nonzero according to probabilities known to the experimenter but will 
choose the stopping stage so as to minimize the experimenters maximum utility. To 
find the mini-max strategy, the tree form of the game can be reduced to the form of a 
rectangular game , and the technique of linear programming can be applied to determine 
the optimal strategies. Considering the size of the tree in this problem, it does not 
seem likely that this approach would be computationally feasible. 

It is true that mini -max strategies are in general randomized strategies. Rather 
than adopting such a randomized strategy it may be more desirable to adopt what might 
be called a security strategy. This would be the strategy of the experimenter which 
maximizes the minimum possible utility. This could be done by examining the expected 
utilities at each of the stopping points and would involve much the same computations as 
the Bayes procedure. 


Assignment of Utility Functions 


The utility function is a function defined upon the space of all possible outcomes of 
a decision problem. This function describes the absolute or relative value to the deci- 
sionmaker of each of these outcomes. Methods of specifying the utility function based 
upon the axioms of utility theory are given in Raiffa (ref. 6) and DeGroot (ref. 13). 

These methods involve choices of lotteries and would be extremely impractical and cum- 
bersome for the current problem. An alternative procedure is often used which attempts 
to place some common evaluation upon each outcome, such as the monetary value, man- 
years of expended energy, and so forth. This approach also seems unlikely of being ap- 
plicable in the present problem. In fact, in only the most trivial of experiment design 
problems does it seem likely that a utility function can be specified which will completely 
describe the relative values of each outcome. This does not at all imply that the deci- 
sion theory approach to statistical decision problems is worthless . As in almost any 
branch of applied mathematics, concessions are made to practicality, and a utility func- 
tion is chosen which is both mathematically tractable and at least roughly representative 
of the decisionmaker's preferences. For example, two such concessions used in the 
theory of estimation are the absolute-error and squared-error loss (negative of utility) 
functions . 

In keeping with the preceding comments, the following five utility functions are of- 
fered as being both practical and somewhat representative of the decisionmaker's pref- 
erences in the appropriate instances: 

if estimator unbiased 
if not 


( 1 ) 
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(2)u.(h)={| 


T his is a utility function which simplifies the expected utility to be the probability of 
getting an unbiased estimate of the parameter. This might be a useful utility function in 
the more basic scientific exploration where relative evaluations of the importance of 
specific parameters are not possible. 

if unbiased 
0 if biased 

This simple utility function can be thought of as representing the prior probability that 
an estimator will be unbiasedly estimating a nonzero quantity. Such a utility function 
might be used in response surface or optimum seeking experiments. This is true be- 
cause a zero parameter contributes nothing toward being able to change the response by 
changing the levels of the independent variables . 

V"h if unbiased 

if biased 


r 


(3) u.(h) = \ 


^ th 

where n n is the number of treatment combinations at the h stopping point. This 

utility function could be useful in the situation where the experimental error is large and 

the cost of many observations is not much more than the cost of a few observations. The 

rationale for this is that the variance of an estimator is proportional to the inverse of the 

number of observations. Thus, one way to weight the value of an unbiased estimate is to 

weight it proportionately to the inverse of the standard deviation, that is, to 

I — if unbiased 

(4) u.(h) =< n h 

[o if biased 

In the opposite situation to function (3) , suppose the experimental error is negligible 
but the cost of each observation is large so that the cost of a stage is a first -degree func- 
tion of the number of treatments. Then this utility function would weight the estimators 
more heavily at the early stages of the experiment and penalize the later stages. 
r 1 

if unbiased 


(5) u.(h) 






if biased 


This is an elementary combination of functions (3) and (4) and is intended for situations 
where both the costs of the observations are large and the experimental error is large. 

Further simple utility functions might consist of multiplicative combinations of (2) 
with one of (3), (4), or (5). 
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CONCLUDING REMARKS 


The two-level fractional factorial designs represent a class of designs of experi- 
ments yielding a large number of estimates of first-degree effects and interactions for 
a small amount of experimentation. The main disadvantage of this class of designs is 
that the estimates are always estimates of aliased combinations of parameters. To 
make conclusions about single parameters it is necessary to have some information 
about the parameters from a source other than the experiment. If such information is 
available before the experiment is performed, it may be incorporated into the design of 
the experiment. 

There are many situations in practice in which an experimenter may have varying 
amounts of information concerning the variables he wishes to investigate. This report 
has developed some optimal design procedures to be used when the prior information is 

(1) For each parameter the experimenter states his prior probability that it is not 

zero 

(2) For each parameter the experimenter states what it is worth to him to obtain an 

unbiased estimate of it 

The information and decisions were formulated as a finite decision problem, and Bayes 
and mini-max procedures were developed. 

The main components of the problem were (1) the choice of estimator -parameter 
matching, (2) the choice of physical -design variable matching, and (3) the evaluations of 
all possible defining parameter groups and sequences of subgroups. 

Modified Bayes and mini-max procedures which are computationally feasible were 
developed, and some potential utility functions were presented. 

The procedures presented herein should prove to be of considerable value in appli- 
cation since the information required is of a nature that is easily specified and the com- 
putations required are amenable to being programmed for a digital computer. 

Lewis Research Center, 

National Aeronautics and Space Administration, 

Cleveland, Ohio, July 21, 1971, 

129-04. 
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APPENDIX A 


B 


B(h) 

B 1? B 



G 


2 


G* 


h 

l 


n 


n h 

Pb 

Pht 


Phs 

Pi 


S(i,h) 

T 

T(h) 


U 

U(h) 

U(i,b) 


SYMBOLS 

complete set of parameters or coefficients 

it. 

subgroup of B used at the h ul stopping point of experiment 
subgroups of B 

estimates of parameters /3^, . . . 
estimates of parameters /3j, . . . 
group 

subgroup of G 

stopping point of experiment 

stage of experiment 

number of factors (independent variables) 

number of treatment combinations at h Ln stopping point 

prior probability of a block effect not being zero 

conditional probability of proceeding to the h + 1 stopping point given 
that the h stopping point is reached 

probability experiment terminates at exactly h tn stopping point 

prior probability that 0 

first stage contains 2 n-r treatment combinations; it is a (l/2) r frac- 
tional factorial 

set of standard -order subscripts of elements of /3^®B(h) 
complete set of treatment combinations 
subgroup of T used at n a stopping point of experiment 
subgroups of T 

1L 

v Ln treatment combination when treatment combinations are arranged in 
their standard order 

total expected utility for a given strategy 

J.1* 

total expected utility of n n stopping point for a given strategy 

expected utility gained by assigning estimator for /3 i ®B(h) to the block 
effect that alias set is confounded with 
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U(i,k) 

u 4 (h) 


V 


w 


w. 


X A’ X B’ * * ‘ 
X 0’ X I 


Y 

y 

&A> @B’ * ' ' 

/3.0B(h) 

e 

5 


( 1 ) 


expected utility gained by assigning the estimator for /3j0B(h) to ^ 

i-u 

utility assigned to an unbiased estimate of /3^ at h stopping point of 
experiment 

standard -order subscript of a parameter or treatment combination for a 
full factorial experiment 

there are 2 W treatments in a block 

used to denote abstractly some combination of the letters a,b, c, . . . 
independent variables (design) 

dummy independent variables which are identically equal to 1 for all 
treatment combinations 

independent variables (physical) 

random response (dependent variable) 

observed value of Y 

parameters of a model equation in design variables 

constant terms of model equation 

parameters of a model equation in physical variables 

coset obtained by multiplying all elements of B(h) by /3^ 

element of 

random error 

group operation 

treatment combination with all independent variables at their low levels 


23 



APPENDIX B 


A HYPOTHETICAL EXPERIMENT WITH FIVE FACTORS 

Consider a five-factor experiment involving 

Xj = temperature 
Xg = pressure 
Xg = time 
X^ = velocity 
Xg = angle 

Suppose that the experimenter’s facilities are such that he can only perform four treat- 
ment combinations at one time and be reasonably sure that experimental conditions are 
homogeneous . Thus his experiment should be designed as a blocked factorial design 
with blocks of size 4. Assume also that he has enough materials at one time to perform 
eight treatment combinations but no more and that batches of uniform material are not 
available in quantities that will supply more than eight treatment combinations. Then the 
blocks of the experiment might be as shown in the following illustration, where the two 
columns represent two different test facilities and the four rows represent four different 
batches of raw material. 


r 


1 


Row blocks 
(batches) ) 


2 

3 


4 




Column blocks 
(test facilities) 


' 1 

2 ^ 

1,1 


I 1 ’ 2 



2,1 


1 2,2 



3,1 


3,2 



ED 


4 , 2 1 
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The differences between the first block and the second block in a row are due to perform- 
ing the experiment in two different test facilities. The differences between rows are due 
to possible effects of new batches of materials. Suppose the experimenter feels that 
there is a probability of 0. 50 of there actually being a test facility block effect. Let the 
probability of there being an effect due to differing batches of raw materials be 1.0. 
Assume further that probability of an interaction between these block effects is specified 
as zero. The stopping points of the experiment are after completion of 

(1) Stage one: block (1, 1) 

(2) Stage two: blocks (1,1), (1,2) 

(3) Stage three: blocks (1,1), (1,2), (2,1), (2,2) 

(4) Stage four: the full factorial 

Let py. be the conditional probability of going on to the next stage, given that the h n 
stage has been completed. Based upon his available resources and upon past histories 
of some similar projects the experimenter has worked on, the following probabilities 
are thought to be appropriate: 


P lt = 0.90 

p 2 t = °. 80 

p 3t = 0.70 
P4t = 0 -° 

j-i_ 

Then the probability of stopping at the h stage is given by p^ g = (1 

where p nf = 1.0 and the symbol TT is taken to be 1.0. Then 
0t j=0 

p ls = (1 - 0.90) = 0.10 

p 2s = (1 - 0.80) (0.90) = 0.18 

p 3g = (1 - 0.70)(0.80)(0.90) = 0.216 

p 4g = (1 - 0 . 0) (0 . 70) (0 . 80) (0.90) = 0.504 

Based on past experience and physical considerations, the experimenter claims the fol- 
lowing: 
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Coefficient 

of- 

Standard - 
order 
subscript 

Prior 
probability 
of being 
nonzero 

x o 

0 

1. 

00 

X 1 

1 

0. 

80 

X 2 

2 



X 2 X 1 

3 



X 3 

4 



X 3 X 1 

5 



X 3 X 2 

6 



X 3 X 2 X 1 

7 



X 4 

8 

1. 

0 

X 4 X 1 

9 


50 

X 4 X 3 

12 


50 

X 4 X 3 X 1 

13 


40 

X 5 

16 

1. 

0 

X 5 X 1 

17 


40 

X 5 X 3 

20 

* 

30 


All the other coefficients have zero prior probability . All that remains to be specified 
is the choice of utility function. Let us assume the investigation is basic research of an 
exploratory nature so that there are no clearly defined consequences of making inappro- 
priate estimates. In this case, it seems reasonable that the experimenter should simply 
try to maximize his probability of making' correct decisions. The utility function 


uj(h) 



if unbiased estimate 
if biased 


will serve the purpose. It is assumed that the purpose of the experiment is to determine 
the effects of changes in the levels of the independent variable and not necessarily the 
mean response. Thus /3 q is assumed to have zero utility. 

Rather than investigating all the possible nonequivalent d.p.g. *s and their tele- 
scoping options, only the following three will be investigated for the best matching of 
physical to design variables. 
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(1) Design I: 


B(l) ={%, PqBA’ % cb , |3 D a» ^EDC’ ^EDBA’ ^EB’ %CA^ 


B(2) - {%, PqbA’ ^EDC’ ^EDBA ^ 


B (3) - {/3p £eDBA^ 

B(4) ={%} 

Using the rules presented in reference 12, it may be seen that the following assignment 
of treatment combinations to the blocks of the experiment will have the block confounding 
as follows: 


Block 

Treatments 

d,i) 

(1), dca, ecb, edba 

(1,2) 

ba, deb, eca, ed 

(2,1) 

db, eba, edc, ea 

(2,2) 

da, c, edeba, eb 

(3,1) 

a, dc, eeba, edb 

(3,2) 

b, deba, ec, eda 

(4,1) 

dba, cb, edca, e 

(4,2) 

d, ca, edeb, eba 


(a) At stage 2 - The estimator for the alias set {/3 DA , &ECA’ %B^ is 

confounded with the test facility block effect which has prior probability 0.50. 

(b) At stage 3 - { /3 BB } con f° un d e d with the test facility block effect. 

{ /3q BA > ^EDC^ * s con t oun< ^ e( ^ with the raw material block effect which has prior proba- 
bility 1.0. 

(c) At stage 4 - {/3 BA } is confounded with the test facility block effect. * ^CBA * ’ 

{ 0 BBBA } , and { } are confounded with the raw material block effect. 
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(2) Design II: 


B(l) = {/3j, /3dcbA’ ^EDCA’ ^EB’ ^EDBA’ %A’ ^CB’ 

B (2) = {/3j, %cbA’ %DCA’ %B^ 

B (3) = {%, %CBA^ 

B (4) = { fij) 

(3) Design IB: 

B (l) = {%, %A’ %B’ ^CA’ ^EDA’ ^EDB’ ^EDCBA’ ^EDC ^ 


B (2) - { %, /3 ba , %DC’ ^EDCBA^ 

B (3) = { ^EDCBA ^ 

B (4) = {^j} 

Table III shows the matching between the physical parameters and the design param- 
eters and the appropriate probabilities when the matching of independent variables is 



For the utility function chosen, computation of the expected utility for each 
parameter -estimator matching need not be performed. The choice that yields the maxi- 
mum utility will be to assign the estimator to the parameter which has the largest prior 
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probability of being nonzero. If there is more than one parameter in an alias set with 

the same largest prior probability, it is immaterial which is chosen since each will 

result in the same expected utility. The specification that (3 q has zero utility and 

P(/3q 4 0) = 1.0 also assures that the estimator for the d.p.g. will always have zero 

expected utility. Thus the computations need not be done for the d.p.g. 

Tables IV to VI present the results of the computations for each of the first three 

stages of the experiment. The d.p.g. for each stage is listed: the cosets, the elements 

of each of the cosets, and the appropriate probabilities. The element 0 K to which 

^max 

the estimator for each coset should be assigned is footnoted. The expected utility for 
this assignment is given for each coset as computed from equations (8) and (9), and the 
total expected utility for each stage is then given. 

For stage 4, note that there will be one unit of utility for each estimator except for 
the estimator of 0 q and those estimators which are confounded with blocks. The esti- 
mator for is confounded with a block effect with probability 0.50. Hence, the 

utility of that estimator is 0.50. The estimators for 0 cra.’ ^EDBA’ anc * 0EDC are 
confounded with a block effect with probability 1.0; and, hence, they have utility zero. 
The estimator for 0 q has zero utility. The remaining 27 estimators all have utility of 
1.0. Thus 


U(4) = 27.00 + 0.50 = 27.5 

The total expected utility according to equation (10) is then 
4 

u (h)p hs = U(l)(0.10) + U(2)(0. 18) + U(3)(0. 216) + U(4)(0.504) 

= (0. 148) (0. 10) + (3 . 40) (0. 18) + (13. 5)(0. 216) + (27. 5)(0. 504) 

= 17.4028 

The calculations just illustrated are quite straightforward but tedious. Further- 
more , the three designs proposed are not equivalent under any permutation of the letters 
since they have different numbers of parameters with the same length subscripts. Thus, 
just to evaluate these three designs would involve 3x5 T . = 360 such computations. The 
program NAMER in reference 9 was developed to perform the permutations and to eval- 
uate them for a given choice of d.p.g. and telescoping sequence. The three designs 
given previously were rim on NAMER, with the results summarized in table VII. For 
each of the three designs under consideration is presented a table which shows the 
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physical -design variable matchings which optimize the total expected utility over all 
stages and the matchings which optimize the expected utilities of each of the stages. 

The modified Bayes solution with respect to these three designs would then be to use 
the matching shown in the column headed ’’Total" for either design 2 or design 3. The 
reason is that the total expected utility for either of these is 17.4298, which is greater 
than the maximized total expected utility for design 1 . 

A modified mini-max solution may also be found . In table VII the minimum in each 
column corresponding to each stopping point is footnooted. The maximum among these 
is seen to be 0. 510 and occurs under the matchings for stages 1, 3, and 4 of design 3 
(all of which are the same for this particular example) . Thus the matching for stage 1 of 
design 3 may be used as a security strategy. 
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TABLE I. - DESIGN MATRIX FOR A 2° FULL FACTORIAL EXPERIMENT 

Treatment Observed Values of independent variables 

response | I j I | j j 


t 0 (i) 


*6 Cb 


2 

1 X A 

X B 

+1 -1 

-1 


+ 1 

-1 


-1 

+ 1 


+ 1 

+ 1 


-1 

-1 


+ 1 

-1 


-1 

+ 1 


f +1 

+ 1 


TABLE H. - DESIGN MATRIX FOR A 2 FACTORIAL RUN IN TWO BLOCKS 
[Each block is a one -half replicate of the full factorial. ] 

Treatment Observed Values of independent variables 


Treatment Observed 
response 


X I 1 X A | X B j X B X A | X C X C X A X C X B X C X B X A 
Block 1 


(i) y x 

+1 

-1 

-1 

+1 

-1 

+1 +1 

ba y 2 



+1 

+1 

+1 

-1 

1 

t-H 

1 

ca y 3 



+1 

-1 

-1 

+1 

+1 -1 

cb y 4 



-1 

+1 

-1 

+1 

-1 +1 


Block 2 




TABLE HI. - MATCHING BETWEEN PHYSICAL PARAMETERS AND DESIGN 


PARAMETERS AND APPROPRIATE PRIOR PROBABILITIES WHEN 
MATCHING OF INDEPENDENT VARIABLES IS = Xp, 

x 2 = x B , x 3 =x c ,x 4 = x E , x g = x A 


Physical- 

variable 

parameters 

Design- 

variable 

parameters 

Parameter 

prior 

probability 

Physical - 
variable 
parameters 

Design- 

variable 

parameters 

Parameter 

prior 

probability 

0 O 

0i 

1 . 

00 

016 

0A 

1 . 

00 

01 

0D 


80 

017 

0DA 


40 

02 

0B 



018 

0BA 

0 


03 

0DB 



019 

0DBA 

0 


04 

0c 



020 

0CA 


30 

05 

0DC 



021 

0DCA 

0 


06 

0CB 



022 

0CBA 



0 7 

0DCB 



023 

0DCBA 



08 

0E 

1 . 

00 

024 

0EA 



09 

0ED 


50 

025 

0EDA 



010 

0EB 

0 


026 

0EBA 



011 

0EDB 

0 


027 

0EDBA 



012 

0EC 


50 

028 

0ECA 



013 

0EDC 

.40 

029 

0EDCA 



014 

0ECB 

0 


030 

0ECBA 



015 

0EDCB 

0 


031 

0EDCBA 




TABLE IV. - EVALUATION AT STAGE 1 


B(l) - |(3j, /3 cba , /3 dcb , % a , /3 edc , % dba , 0 eb . %ca} “ {^0’ ^22’ &\V ^13> ^27’ ^10> ^2s}‘ 


Elements and probabilities 


TTd - Pj) U(i,k max ) 



0BA® B ^ " Element %a * @18 @C ~ @ 4 @DCA ~ @ 21 %B " ^3 ^EDCBA " ^31 %D " ^9 @EA ~ @ 24 ^ECB “ #14 


U(l) =£u(i,k max ) = 0.148 


Denotes the element to which estimator for each coset should be assigned. 




















i 

Y 

y 

i TABLE V. - EVALUATION AT STAGE 2 


[b( 2) - /3 cba , 0 edc , %DBa} = {^O’ 022’ 013’ ^ 27 }'] 


Coset 


Elements and probabilities 


mi - Pj) 

(1 - Pb)TT(l - Pj) 


/3 a ©B(2) = 

Element 

0A ~ 016 

0CB - 06 

0EDCA ~ 029 

0EDB "011 




%©B(2) 

p j 

1.00 

0.80 

0.00 

0.00 




♦ 

x - p j 

0.00 

0.20 

1.00 

1.00 

0.20 


0.20 



(a) 







%®B(2) = 

Element 

0B = 02 

0CA = 020 

0EDCB = 015 

0EDA = 025 




/3 2 ®B(2) 

p i 

0.80 

0.30 

0.00 

0.00 





1 - p j 

0.20 

0.70 

1.00 

1.00 

0.70 


0.70 



(a) 







/3 ba ®B(2) = 

Element 

0BA = 018 

0C = 04 

0EDCBA = 031 

0ED = 09 




#3 18 ®B(2) 

p j 

0.00 

0. 80 

0.00 

0.50 




| 

1 - p ] 

1.00 

0.20 

1.00 

0.50 

0.50 


0.50 

1 



(a) 






f (3 d ®B(2) = 

Element 

0D - $1 

0DCBA = 023 

0EC = 012 

0EBA = 026 




; /3 X ®B(2) 

p j 

0. 80 

0.00 

0.50 

0.00 




} 

x - p i 

0.20 

1.00 

0.50 

1.00 

0.50 


0.50 



(a) 





i 


! )3 da ®B(2) = 

Element 

0DA = 017 

0DCB = 07 

0ECA = 028 

0EB = 010 




I 0 17 ®B(2) 

p .i 

0.40 

0.80 

0.00 

0.00 





x - p i 

0.60 

0.20 

1.00 

1.00 

0.60 

(0 . 50) (0 . 60) -0. 30 

0.30 




(a) 






% b ®B(2) = 

Element 

^DB = ^3 

0DCA = 021 

0ECB = 014 

0EA 3 024 




/5g®B(2) 

p j 

0. 80 

0.00 

0.00 

0.00 





x - p j 

0.20 

1 1.00 

1.00 

1.00 

1.00 


1.00 



(a) 







. %>BA® B < 2 > = 

Element 

0DBA = 019 

0DC = 05 

0ECBA = 030 

0E = 08 




/3 19 ®B(2) 

p s 

0.00 

0. 80 

0.00 

1.00 





x - p j 

1.00 

0.20 

1.00 

0.00 

0.20 


0.20 

■7 



1 

i 

(a) 

1 











U(2 

) = 3.40 


a Denotes the element to which the estimator for each coset should be assigned, 

max 


I - 
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TABLE VI. - EVALUATION AT STAGE 3 


js(3) - {/%, % DBA } - {/3 q , ^ 2 7 }' J 


Coset 

Elements and probabilities 

ml ■ Pj) 

- PbMl - Pj) 

1 U(i,k J 
' ’ max' 


Element 

P 3 

1 - P 

Element 

p i 

| 1 - E 

j 


/3 A ©B(3) = 

^A = ^16 
(a) 

1.00 

0.00 

%DB = Hi 

0.00 

1.00 

1.00 


1.00 

%®B(3) = 

% = /3 2 

(a) 

0.80 

0.20 

&EDA = ^25 

0.00 

1.00 

1.00 


1.00 

%A® B(3) = 

^BA = ^18 

0.00 

1.00 

0ED = % 
(a) 

0.50 

0.50 

1.00 


1.00 

/3 C ®B(3) = 

/3 C = 
(a) 

0.80 

0.20 

%DCBA = ^3 1 

0.00 

1.00 

1.00 


1.00 

/3 C A® B(3) = 

&CA = ^20 
(a) 

0.30 

0.70 

%DCB = %5 

0.00 

1.00 

1.00 


1.00 

^CB® B ^ 3 ) ~ 

^CB = h 
(a) 

0.80 

0.20 

^EDCA = ^29 

0.00 

1.00 

1.00 


1.00 

^cba® b ^ 3 ^ = 

^CBA " Hi 

0.00 

1.00 

^EDC = ^13 
(a) 

0.40 

0.60 

1.00 

(0. 0H1.00) 

0.00 

/3 d ®B(3) = 

% = /3i 

(a) 

0. 80 

0.20 

^EBA = ^26 

0.00 

1.00 

1.00 



1.00 

%)a® b ( 3 ) = 

%A = ^17 
(a) 

0.40 

0.60 

Hb = %o 

0.00 

1.00 

1.00 

(0.50(1.00 

0.50 

/3 db ®B(3) = 

%B = ^3 
(a) 

0.80 

0.20 

%A = ^24 

0.00 

1.00 

1.00 


1.00 

%ba® b ( 3 ) = 

%BA = ^19 

0.00 

1.00 

% = @8 
(a) 

1.00 

0.00 

1.00 


1.00 

£dc® b ^ = 

%c = % 
(a) 

0.80 

0.20 

^ECBA = ^30 

0.00 

1.00 

1.00 


1.00 

£dca® b ® = 

%>CA = ^21 
(a) 

0.00 

1.00 j 

8 ECB = ^14 

0.00 

1.00 

1.00 


1.00 

%>CB® B ( 3 ) = 

%CB = H 
(a) 

0.80 

0.20 / 

3 ECA = ^28 

0.00 

1.00 

1.00 


1.00 

%CBA® B ^ 3 ^ = i 

%CBA = ^23 

0.00 

1.00 (1 

( 

*EC = ^12 
a) 

0. 50 

0. 50 

1.00 


1.00 









u(3) 

- 13.5 


a Denotes the element 


to which estimator for each coset should be assigned. 
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TABLE VII. - OPTIMAL MATCHINGS 


(a) Design 1 


Physical variable 

Total 

Stage 1 

Stage 2 

Stage 3 

Stage 4 


Physical -design variable matchings which 


optimize the expected utilities 

Temperature 

D 

A 

D 

A 

A 

Pressure 

B 

C 

A 

B 

B 

Time 

C 

D 

B 

C 

C 

Velocity 

E 

B 

C 

D 

D 

Angle 

A 

E 

E 

E 

E 

Stage 

Expected utilities of matchings 

Total 

17.4028 

17.1851 

17.2062 

17.310 

17.310 

1 

. 148 

a . 221 

a . 144 

a . 12 

a . 12 

2 

3. 400 

.347 

3.93 

2.90 

2.90 

3 

13. 50 

12.40 

12.15 

13. 50 

13.50 

4 

27. 50 

27.50 

27.50 

27.50 

27.50 


(b) Design 2 


Physical variable 

Total 

Stage 1 

Stage 2 

Stage 3 

Stage 4 


Physical -design variable matchings which 
optimize the expected utilities 

Temperature 

C 

A 

C 

C 

A 

Pressure 

D 

C 

A 

D 

B 

Time 

E 

D 

D 

E 

C 

Velocity 

B 

B 

B 

B 

D 

Angle 

A 

E 

E 

A 

E 

Stage 


Expected utilities of matchings 

Total 

17.4298 

16.9979 

17.0578 

17.4298 

16.9963 

1 

.148 

a . 221 

a . 19 

a . 148 

a . 124 

2 

3.55 

3.75 

4.10 

3. 55 

3.795 

3 

13.50 

11.30 

11.30 

13.50 

11.30 

4 

27. 50 

27.50 

27.50 

27.50 

27. 50 


a Minimum in each column corresponding to a single stage. 


E - Choose 
initial defining 
parameter 


TABLE VII. - Concluded. OPTIMAL MATCHINGS 


(c) Design 3 


Physical variable 

Total 

Stage 1 

Stage 2 

Stage 3 

Stage 4 


Physical -design variable matchings which 
optimize the expected utilities 

Temperature 

C 

A 

C 

A 

A 

Pressure 

D 

B 

D 

B 

B 

Time 

A 

C 

A 

C 

C 

Velocity 

B 

D 

B 

D 

D 

Angle 

E 

E 

E 

E 

E 

Stage 


Expected utilities of 

matching* 

3 

Total 

17.4298 

17.4210 

17.4298 

17.4210 

17.4210 

1 

.148 

a . 510 

a . 148 

a . 510 

a . 510 

2 

3.55 

3.30 

3.55 

3.30 

3.30 

3 

13.50 

13.50 

13.50 

13.50 

13.50 

4 

27.50 

27.50 

27.50 

27.50 

27.50 


a Minimum in each column corresponding to a single stage. 
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Figure 1. - Flow chart representing sequence of choices made by experimenter and 
nature. (E denotes a choice made by experimenter; N denotes a choice made bv 

nature 1 J 
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